Emotion effects in visual language processing

Emotionale Bedeutung erleichtert die Verarbeitung geschriebener Sprache. Dies zeigt sich sowohl in Verhaltensmaßen als auch in ereigniskorrelierten Potenzialen (EKPs) und resultiert vermutlich aus automatischer Aufmerksamkeitszuweisung auf Grund der hohen intrinsischen Relevanz von emotionalen Reizen. Die vorliegende Arbeit untersucht die Mechanismen von Emotionseffekten in geschriebener Sprache, insbesondere den Zeitverlauf der Emotionseffekte, die Beteiligung des peripheren Nervensystems, sowie die Rolle der Emotionsdimensionen Valenz und Erregung. Emotionseffekte in EKPs beginnen mit einer Latenz von 100 ms nach Stimulusonset. Dies deutet auf die Existenz eines schnellen und automatischen Erkennungssystems für emotionale Wörter hin. Zeitverlauf und Verteilung der Emotionseffekte weisen große Ähnlichkeit zu Befunden für emotionale Bilder auf und lassen auf ein domänenübergreifenden System zur Emotionserkennung schließen. Übereinstimmend mit dieser Annahme zeigen sich weitere Ähnlichkeiten in der Verarbeitung emotionaler Wörter und Bilder in einer Studie, die die Interaktion von stimulusbasierter Aufmerksamkeit und Emotion in der Wortverarbeitung untersuchte. Die Ergebnisse dieser Studie legen auf Grund des arbiträren Charakters von Schriftsprache den Schluss nahe, dass der Verarbeitungsvorteil für emotionale Reize zu einem geringeren Anteil als bisher vermutet auf biologischer Relevanz beruht. Neben diesen Ähnlichkeiten zeigt sich ein domänenspezifischen Unterschied in der Emotionsverarbeitung. Während die Darbietung emotionaler Bilder oft mit erhöhter Aktivierung des autonomen Nervensystems einhergeht, zeigen Befunde zur Pupillenaktivität, dass die Verarbeitung emotionaler Wörter nicht zwangsläufig zu autonomer Aktivierung führen muss; stattdessen scheint der Verarbeitungsvorteil für emotionale Wörter darauf zu beruhen, dass weniger kognitive Ressourcen für deren Verarbeitung notwendig sind.Emotional meaning impacts the processing of written words, leading to facilitated processing that is visible not only in behavioral parameters, but also in event-related potentials (ERPs). It has been suggested that this processing benefit occurs because emotional stimuli involuntarily attract attention, possibly based on their higher intrinsic relevance. The present work investigates the conditions of emotion effects in word recognition, focusing on the time course of emotional processing, on the involvement of autonomic activation, and on contributions of emotional dimensions valence and arousal. In ERPs, emotion effects were evident from approximately 100 ms after stimulus onset, providing evidence for a fast and automatic detection and facilitation of emotional words. The time course and topography of emotion effects is in parallel to findings for affective pictures and suggests the existence of a common system for the extraction of emotional content across stimulus domains. In line with these findings, interactions of stimulus-triggered attention and emotion during word recognition are highly similar to interactions in picture processing. Due to the symbolic nature of words, this finding implies that emotion detection is less dependent on biological relevance than previously assumed. Apart from these analogies, the present results revealed a difference in emotional processing across stimulus domains. While affective pictures have frequently been reported to elicit augmented activity in the autonomic nervous system, evidence from pupillary responses indicates that emotional words do not mandatorily trigger autonomic activation. Instead, the processing advantage visible in behavioral measures seems to result from cognitive facilitation of emotional words

Preschoolers’ Sensitivity to Negative and Positive Emotional Facial Expressions: An ERP Study

The study examined processing differences for facial expressions (happy, angry, or neutral) and their repetition with early (P1, N170) and late (P3) event-related potentials (ERPs) in young children (N = 33). EEG was recorded while children observed sequentially presented pairs of facial expressions, which were either the same (repeated trials) or differed in their emotion (novel trials). We also correlated ERP amplitude differences with parental and child measures of socio-emotional competence (emotion recognition, empathy). P1 amplitudes were increased for angry and happy as compared to neutral expressions. We also detected larger P3 amplitudes for angry expressions as compared to happy or neutral expressions. Repetition effects were evident at early and late processing stages marked by reduced P1 amplitudes for repeated vs. novel happy expressions, but enhanced P3 amplitudes for repeated vs. novel facial expressions. N170 amplitudes were neither modulated by facial expressions nor their repetition. None of the repetition effects were associated with measures of socio-emotional competence. Taken together, negative facial expressions led to increased neural activations in early and later processing stages, indicative of enhanced saliency to potential threating stimuli in young children. Processing of repeated facial expression seem to be differential for early and late neural stages: Reduced activation was detected at early neural processing stages particularly for happy faces, indicative of effective processing for an emotion, which is most familiar within this age range. Contrary to our hypothesis, enhanced activity for repeated vs. novel expression independent of a particular emotion were detected at later processing stages, which may be linked to the creation of new memory traces. Early and late repetition effects are discussed in light of developmental and perceptual differences as well as task-specific load.Peer Reviewe

Simultaneous EEG-fMRI reveals attention-dependent coupling of early face processing with a distributed cortical network

The speed of visual processing is central to our understanding of face perception. Yet the extent to which early visual processing influences later processing in distributed face processing networks, and the top-down modulation of such bottom-up effects, remains unclear. We used simultaneous EEG-fMRI to investigate cortical activity that showed unique covariation with ERP components of face processing (C1, P1, N170, P3), while manipulating sustained attention and transient cognitive conflict employing an emotional face-word Stroop task. ERP markers of visual processing within 100 ms after stimulus onset showed covariation with brain activation in precuneous, posterior cingulate gyrus, left middle temporal gyrus, left inferior frontal gyrus and frontal operculum, and a left lateral parietal-occipital cluster, illustrating the impact of early stage processing on higher-order mechanisms. Crucially, this covariation depended on sustained attentional focus and was absent for incongruent trials, suggesting flexible top-down gating of bottom-up processing

Pupillary Responses to Faces Are Modulated by Familiarity and Rewarding Context

Observing familiar (known, recognisable) and socially relevant (personally important) faces elicits activation in the brain’s reward circuit. Although smiling faces are often used as social rewards in research, it is firstly unclear whether familiarity and social relevance modulate the processing of faces differently, and secondly whether this processing depends on the feedback context, i.e., if it is different when smiles are delivered depending on performance or in the absence of any action (passive viewing). In this preregistered study, we compared pupillary responses to smiling faces differing in subjective familiarity and social relevance. They were displayed in a passive viewing task and in an active task (a speeded visual short-term memory task). The pupils were affected only in the active task and only by subjective familiarity. Contrary to expectations, smaller dilations were observed in response to more familiar faces. Behavioural ratings supported the superior rewarding context of the active task, with higher reward ratings for the game than the passive task. This study offers two major insights. Firstly, familiarity plays a role in the processing of social rewards, as known and unknown faces influence the autonomic responses differently. Secondly, the feedback context is crucial in reward research as positive stimuli are rewarding when they are dependent on performance.Deutscher Akademischer AustauschdienstPeer Reviewe

Autistic Traits Affect Reward Anticipation but not Reception

Autism spectrum conditions (ASC) have been linked to aberrant reward processing, but it remains unclear whether it is a general dysfunction or limited to social stimuli, and whether it affects both phases of reward processing, namely anticipation and reception. We used event-related brain potentials and a population-based approach to investigate reward anticipation and reception to socially relevant (i.e., picture of experimenter’s face showing approval/disapproval) and monetary rewards in 51 neurotypical individuals with varying levels of autistic traits. Higher autistic traits were associated with enhanced reward anticipation across reward types in the early anticipation phase (triggered by incentive cues), but not in the late anticipation phase (directly before reward reception), as reflected by the CNV component. The P3 component in response to reward reception showed a general increase for monetary outcomes, which was not modulated by autistic traits. These results suggest that higher autistic traits are related to enhanced reward anticipation, but do not modulate reward reception. No interaction between reward types and autistic traits was observed. We propose that the relevance of social rewards had higher reward value than commonly used pictures of strangers, which specifically normalised responses for individuals with high autistic traits.Peer Reviewe

Font size matters--emotion and attention in cortical responses to written words.

For emotional pictures with fear-, disgust-, or sex-related contents, stimulus size has been shown to increase emotion effects in attention-related event-related potentials (ERPs), presumably reflecting the enhanced biological impact of larger emotion-inducing pictures. If this is true, size should not enhance emotion effects for written words with symbolic and acquired meaning. Here, we investigated ERP effects of font size for emotional and neutral words. While P1 and N1 amplitudes were not affected by emotion, the early posterior negativity started earlier and lasted longer for large relative to small words. These results suggest that emotion-driven facilitation of attention is not necessarily based on biological relevance, but might generalize to stimuli with arbitrary perceptual features. This finding points to the high relevance of written language in today's society as an important source of emotional meaning

Reward responsiveness in autism and autistic traits – Evidence from neuronal, autonomic, and behavioural levels

Autism has been linked to atypicalities in reward processing, especially in the social domain. However, results are heterogeneous, and their interpretation is hindered by the use of personally non-relevant social rewards. In this study we investigated behavioural (reaction times), neuronal (event-related potentials), and autonomic (pupil sizes) responses to personally relevant social rewards, money, and neutral outcomes in 26 autistic and 53 non-autistic subjects varying in levels of autistic traits. As hypothesised and preregistered, autism and autistic traits did not differently influence responses to social, monetary, or neutral outcomes on either response level. While groups did not differ in behaviour (reaction times), autism was linked to generally enhanced brain responses in early anticipation and larger pupil constrictions in reward reception. Together, these results suggest that when using personally relevant stimuli, autism is linked to generally preserved, although less neuronally efficient processing of rewards. Considering the role of social relevance in reward processing, we propose an interpretation of contradictory evidence from clinical practice and empirical research

It’s who, not what that matters: personal relevance and early face processing

The faces of our friends and loved ones are among the most pervasive and important social stimuli we encounter in our everyday lives. We employed EEG to investigated the time line of personally relevant face processing and potential interactions with emotional facial expressions by presenting female participants with photographs of their romantic partner, a close friend, and a stranger, displaying fearful, happy and neutral facial expressions. Our results revealed elevated activity to the partner’s face from 100 ms after stimulus onset as evident in increased amplitudes of P1, EPN, P3 and LPC components, while there were no effects of emotional expressions, and no interactions. Our findings indicate the prominent role of personal relevance in face processing; the time course of effects further suggests that it might not rely solely on the core face processing network, but might start even before the stage of structural face encoding. Our results suggest a new direction of research in which face processing models should be expanded to adequately capture the dynamics of the processing of real-life, personally relevant faces